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Abstract 

An information agent is viewed as a deductive database consisting of 3 parts: 

• an observation database containing the facts the agent has observed or sensed from 
its surrounding environment. 

• an input database containing the information the agent has obtained from other agents 

• an intensional database which is a set of rules for computing derived information from 
the information stored in the observation and input databases. 

Stabilization of a system of information agents represents a capability of the agents to 
eventually get correct information about their surrounding despite unpredictable environ¬ 
ment changes and the incapability of many agents to sense such changes causing them 
to have temporary incorrect information. We argue that the stabilization of a system of 
cooperative information agents could be understood as the convergence of the behavior 
of the whole system toward the behavior of a “superagent”, who has the sensing and 
computing capabilities of all agents combined. We show that unfortunately, stabilization 
is not guaranteed in general, even if the agents are fully cooperative and do not hide any 
information from each other. We give sufficient conditions for stabilization. We discuss the 
consequences of our results. 

KEYWORDS'. Stabilization, Cooperative Information Agents, Logic Programming 


1 Introduction 

To operate effectively in a dynamic and unpredictable environment, agents need 
correct information about the environment. Often only part of this environment 
could be sensed by the agent herself. As the agent may need information about 
other part of the environment that she could not sense, she needs to cooperate 
with other agents to get such information. There are many such systems of cooper¬ 
ative information agents operating in the Internet today. A prominent example of 
such system is the system of routers that cooperate to deliver messages from one 
place to another in the Internet. One of the key characteristics of these systems is 
their resilience in the face of unpredictable changes in their environment and the 
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incapability of many agents to sense such changes causing them to have temporary 
incorrect information. This is possible because agents in such systems cooperate by 
exchanging tentative partial results to eventually converge on correct and consistent 
global view of the environment. Together they constitute a stabilizing system that 
allows the individual agents to eventually get a correct view of their surrounding. 

Agent communications could be classified into push-based communications and 
pull-based communications. In the push-based communication, agents periodically 
send information to specific recipients. Push-based communications are used widely 
in routing system, network protocols, emails, videoconferencing calls, etc. A key 
goal of these systems is to guarantee that the agents have a correct view of their 
surrounding. On the other hand, in the pull-based communication, agents have 
to send a request for information to other agents and wait for a reply. Until 
now pull-based communications are the dominant mode of communication in re¬ 
search in multiagent systems, e.g. IlShoham 1993|l . USatoh and Yamamoto 200'^ . 

I lCiampolini et al. 2003| ), IjKowalski and Sadri 1999|l . HWooldridge 1997| ), l |Wooldridge and Jennings 1995| ). 
In this paper, we consider multiagent systems where agent communications are 
based on push-technologies. A prominent example of a push-based multiagent sys¬ 
tem is the internet routing system. 

This paper studies the problem of stabilization of systems of cooperative infor¬ 
mation agents where an information agent is viewed as a deductive database which 
consists of 3 parts: 

• an observation database containing the facts the agent has observed or sensed 
from its surrounding environment. 

• an input database containing the information the agent was told by other 
agents 

• an intensional database which is a set of rules for computing derived infor¬ 
mation from the information stored in the observation and input databases. 

It turns out that in general, it is not possible to ensure that the agents will 
eventually have the correct information about the environment even if they honestly 
exchange information and do not hide any information that is needed by others and 
every change in the environment is immediately sensed by some of the agents. We 
also introduce sufficient conditions for stabilization. 

The stabilization of distributed protocols has been studied extensively in the lit¬ 
erature ( dPijkstra I974| ). JPlatebo et al. I994ll . llSchneider 1993|l l where agents are 
defined operationally as automata. Dijkstra defined a system as stabilizing 

if it is guaranteed to reach a legitimate state after a finite number of steps regard¬ 
less of the initial state. The definition of what constitutes a legitimate state is left 
to individual algorithms. Thanks to the introduction of an explicit notion of en¬ 
vironment, we could characterize a legitimate state as a state in which the agents 
have correct information about their environment. In this sense, we could say that 
our agents are a new form of situated agents ( URosenschein and Kaelbling 1995| ), 

IjRrooks 199111 . IjRrooks 1 98611 1 that may sometimes act on wrong information but 
nonetheless will be eventually situated after getting correct information about their 
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surrounding. Further in our approach, agents are defined as logic programs, and 
hence it is possible for us to get general results about what kind of algorithms 
could be implemented in stabilizing multiagent systems in many applications. To 
the best of our knowledge, we believe that our work is the first work on stabilization 
of multiagent systems. 

The rest of this paper is organized as follows. Basic notations and definitions used 
in this paper are briefly introduced in section |2 We give an illustrating example 
and formalize the problem in section |21 Related works and conclusions are given in 
sectional Proofs of theorems are given in Appendices. 

2 Preliminaries: Logic Programs and Stable Models 

In this section we briefly introduce the basic notations and definitions that are 
needed in this paper. 

We assume the existence of a Herbrand base HB. 

A logic program is a set of ground clauses of the form: 

H < Lx,..., Am 

where H is an atom from HB, and Li,..., Lm are literals (i.e., atoms or negations 
of an atoms) over HB, m > 0. H is called the head, and Ai,..., A^ the body of 
the clause. 

Given a set of clauses S, the set of the heads of clauses in S is denoted by head(S). 

Note that clauses with variables are considered as a shorthand for the set of all 
their ground instantiations. Often the variables appearing in a non-ground clause 
have types that are clear from the context. In such cases these variables are instan¬ 
tiated by ground terms of corresponding types. 

For each atom a, the definition of a is the set of all clauses whose head is a. 

A logic program is bounded if the definition of every atom is finite. 

Let P be an arbitrary logic program. For any set S C HB, let be a program 
obtained from P by deleting 

1. each rule that has a negative literal ^B in its body with B G S, and 

2. all negative literals in the bodies of the remaining rules 

5” is a stable model i llGelfond and Lifschitz 198811 1 of P if 5 is the least model of 
P^. 

The atom dependency graph of a logic program P is a graph, whose nodes are 
atoms in HB and there is an edge from a to 6 in the graph iff there is a clause in 
P whose head is a and whose body contains b or -i6. Note that in the literature 
| |Apt et al. 1988| |, the direction of the link is from the atom in the body to the head 
of a clause. We reverse the direction of the link for the ease of definition of acyclicity 
using the atom dependency graph. 

An atom b is said to be relevant to an atom a if there is a path from a to 6 in 
the atom dependency graph. 

A logic program P is acyclic iff there is no infinite path in its atom dependency 
graph. It is well known that 
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Lemma 2. 1 ( iGelfond and Lifschitz 198^ ) 

Each acyclic logic program has exactly one stable model. 


3 Examples and Problem Formalization 

Routing is one of the most important problems for internetworking. Inspired by 
RIP lIHuitema 200011 . one of the most well-known internet routing protocols, we 
will develop in this section, as an example, a multiagent system for solving the 
network routing problem to motivate our work. 

Example 3.1 

Consider a network in Fig.^] For simplicity we assume that all links have the same 
cost, say 1 . 


A\ A 2 A 3 



Fig. 1. A network example 

The problem for each agent is to find the shortest paths from her node to other 
nodes. The environment information an agent can sense is the availability of links 
connecting to her node. The agents use an algorithm known as “distance vector 
algorithm” f lBellman 195711 . IIFord and Fulkerson 1962ll l to find the shortest paths 
from their nodes to other nodes. If the destination is directly reachable by a link, the 
cost is 1. If the destination is not directly reachable, an agent needs information 
from its neighbors about their shortest paths to the destination. The agent will 
select the route to the destination through a neighbor who offers a shortest path to 
the destination among the agent’s neighbors. Thus at any point of time, each agent 
needs three kinds of information: 

• The information about the environment, that the agent can acquire with her 
sensing capability. In our example, agent Ai could sense whether the links 
connecting her and her neighbors ^ 2,^4 are available. 

• The algorithm the agent needs to solve her problem. In our example the 
algorithm for agent Ai is represented by the following clauses: ^ 

^ Contrary to the convention in Prolog, in this paper we use lower-case letters for variables and 
upper-case letters for constants. 
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sp{Ai,Ai,0) ^ 

sp{Ai ,y,d) ^ spt{Ai,y,x,d) 

spt{Ai,y,x,d + 1) ^ link{Ai,x), sp(x,y,d), 

not spl{Ai, y,d-\- 1) 

spli^Ai, Ai, d1^ <— 

spl{Ai,y, d + 1) ^ link{Ai,x), sp(x,y,d'),d' < d 

where 

link{Ai, Aj) is true iff there a link from Ai to Aj in the network and the link is 
intact. Links are undirected, i.e. we identify link{Ai, Aj) and link{Aj,Ai). 
sp{Ai,y, d) is true iff a shortest path from Ai to y has length d 
spt{Ai,y,x,d) is true iff the length of shortest paths from Ai to y is d and 
there is a shortest path from Ai to y that goes through x as the next node 
after Ai 

spl{Ai, y, d) is true iff there is a path from Ai to y whose length is less than 

d. 

• The information the agent needs from other agents. For agent Ai to calculate 
the shortest paths from her node to say A 3 , she needs the information about 
the length of the shortest paths from her neighbors A 2 , and A 4 to A 3 , that 
means she needs to know the values d, d' such that sp(A 2 , A 3 , d), sp(A 4 , As,d') 
hold. 


3.1 Problem Formalization 

The agents are situated in the environment. They may have different accessibility 
to the environment depending on their sensing capabilities. The environment is 
represented by a set of (ground) environment atoms, whose truth values could 
change in an unpredictable way. 

Definition 3.1 

An agent is represented by a quad-tuple 

A = {IDE, HBE, HIN, 6) 

where 

• IDE, the intensional database, is an acyclic logic program. 

• HEE is the set of all (ground) environment atoms whose truth values the 
agent could sense, i.e. a S HEE iff A could discover instantly any change in 
the truth value of a and update her extensional database accordingly. 

• HIN is the set of all atoms called input atoms, whose truth values the agent 
must obtain from other agents. 

No atom in HIN U HEE appears in the head of the clauses in IDE and 
HIN n HEE = 0. 

• d is the initial state of the agent. 
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Definition 3.2 

An agent state is a pair cr = {EDB, IN) where 

• EDB C HBE represents what the agent has sensed from the environment. 
That means for each a G HBE, a £ EDB iff a is true. 

• IN C HIN , the input database of A, represents the set of information A has 
obtained from other agents, i.e. a £ IN iff A was told that a is true. 

Given a state cr = {EDB, IN), the stable model of A = {IDB, HBE, HIN, 6 ) at 
a is defined as the stable model of IDB U EDB U IN . Note that 5 and a could be 
different states. 

Example 3.2 {Continuation of the network routing example) 

Imagine that initially the agents have not sent each other any information and all 
links are intact. In this situation, agent Ai is represented as follows: 

• IDBi contains the clauses shown in Example ED 

• HBEi = {link{Ai,A2),link{Ai,A4)'\ 

• HINi consists of ground atoms of the form 

sp{A 2 ,Y,D), sp{A 4 ^,Y,D) 

where Y £ {A 2 ,..., A 5 } and D is a positive integer. 

• The initial state = {EDBi^q, INi^q) where 

EDBi o = {link{Ai, A 2 ), link{Ai, A 4 )} 

INi^o = 0 


Definition 3.3 

A cooperative multiagent system is a collection of n agents {Ai,..., An), with Ai= 
{IDBi,HBEi, HINi, 5i) such that the following conditions are satisfied 

• for each atom a, if a £ head{IDBi) n head{IDBj) then a has the same 
definition in IDBi and IDBj. 

n 

• for each agent Ai, HINi C [J {head{IDBj) U HBEj) 

J = 1 

• No environment atom appears in the head of clauses in the intentional database 
of any agent, i.e. for all i,j: HBEi H head{IDBj) = 0. 

For each agent Ai let HBi = head{IDBi) U HBEi U HINi. 


3.2 Agent Communication and Sensing 

Let Ai = {IDBi, HBEi, HINi, 5i) for \ < i < n. We say that Ai depends on Aj 
if Ai needs input from Aj, i.e. HINi G {head{IDBj) U HBEj) 0. The depen¬ 
dency of Ai on Aj is defined to be the set D{i,j) = HINin{head{IDBj)UHBEj). 

As we have mentioned before, the mode of communication for our agents corre¬ 
sponds to the “push-technology”. Formally, it means that if Ai depends on Aj 
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then Aj will periodically send Ai a set S = D{i,j) n Mj where Mj is the sta¬ 
ble model of Aj. When Ai obtains S, she knows that each atom a € D{i,j) \ S 
is false with respect to Mj. Therefore she will update her input database INi to 
Upaij{INi, S) as follows 

UpaijilNi, S) = {INi \ D{i,j)) U S 

Thus her state has changed from ai = {EDBi, INi) to cr' = {EDBi, Upaij{INi, S)) 
accordingly. 

An environment change is represented by a pair C = (T, F) where T (resp. F) 
contains the atoms whose truth values have changed from false (resp. true) to 
true (resp. false). Therefore, given an environment change {T,F), what Ai could 
sense of this change, is captured by the pair {Ti,Fi) where Ti = T <1 HBEi and 
Fi = FOHBEi. Hence when a change C = (T, F) occurs in the environment, agent 
Ai will update her sensing database EDBi to Upei{EDBi,C) as follows: 

Upe,{EDB„ C) = {EDB, \ F,) U T, 

The state of agent Ai has changed from ai = {EDBi,INi) to a) = {Upei{EDBi, C), 
INi) accordingly. 


3.3 Semantics of Multiagent Systems 
Let 

A = {Ai ,..., An) 

with 

A, = {IDB,,HBE,,HINi,S,) 

be a multiagent system. (5i,..., Sn) is called the initial state of A. 

A state of A is defined as 

A = (cti, ... ,(j„) 

such that ai is a state of agent Ai. 

There are two types of transitions in a multiagent system. A environment transi¬ 
tion happens when there is a change in the environment which is sensed by a set of 
agents and causes these agents to update their extensional databases accordingly. 
A communication transition happens when an agent sends information to another 
agent and causes the later to update her input database accordingly. 

For an environment change C = {T,F), let Sc be the set of agents which could 
sense parts of C, i.e. 


Fc = {A, I HBE, n (T U F) ^ 0} 
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Definition 3.4 

Let A = (cti, ..., (T„), A' = {af .. a'„) be states of A with at = {EDBi, INi), 
= {EDB[,IN'^. 


1. A environment transition 

A A' 

caused by an environment change C = (T, E) is defined as follows 

(a) for every agent Ak such that Ak ^ Sc- crk = and 

(b) for each agent Ai € Sc- 

• EDB' = Upe^{EDB„C), 

• IN' = INi. 

2. A communication transition 

A a A' 

caused by agent Aj sending information to agent Ai, where Ai depends on 
Aj, is defined as follows: 

(a) For all k such that k v. Ck = (r'k 

(b) EDB'^ = EDBi and IN'^ = Upaij{INi, S) where S = D{i, j)C\Mj 
and Mj is the stable model of Aj at Cj. 

We often simply write A ^ A' if there is a transition A A' or A -—^ A'. 


Definition 3.5 

A run of a multiagent system A is an infinite sequence 

Ao ^ Ai ^ ^ Am ^ . 


such that 


• Ao is the initial state of A and for all agents Ai, Aj such that Ai depends on 
Aj the following condition is satisfied: 

For each h, there is a k > h such that Ak -—^ A^+i 

The above condition is introduced to capture the idea that agents periodically 
send the needed information to other agents. 

• There is a point h such that at every fc > ft- in the run, there is no more 
environment change. 


For a run IZ = Aq ^ Ai ^ ... ^ Ak ^ ... where Ak = • • • , ckn^k) we 

often refer to the stable model of Ai at state Ci^k as the stable model of Ai at point 
k and denote it by Mi^k- 
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A = (Ai,A2 ) 


where 


IDBi 

= {a <— 6, c 
/ ^ a} 

IDB2 

i i 

II 

HBEi 

= {c} 

HBE2 

= {d,e} 

HINi 

= {b} 

HIN2 

= {«} 

EDB^ Q 

= {4 

EDB2P 

= {d,e} 


= 0 

IN2P 

= 0 


Consider the following run TZ, where the only environment change occurs at point 
2 such that the truth value of e becomes false: 


. 2^1 . 1^2 . ( 0 .{e}) A l'^2 . 2~^1 . 

Ao -> Ai -> A2 -> A3 -> A4 -> As . . . 


The states and stable models of Ai and A 2 at points 0, 1, 2, 3, and 4 are as follows 



Ai 

A 2 

k 

EDB 

IN 

Stable Model 

EDB 

IN 

Stable Model 

0 

{4 

0 

{4 

{d, e} 

0 

{&, d,e} 

1 

{4 

{4 

{a,b, c,/} 

{d,e} 

0 

{&, d,e} 

2 

{4 

{4 

{a,b, c,/} 

{d,e} 

{a} 

{a,b,d,e} 

3 

{4 

{4 

{a,b, c,/} 

{d} 

{«} 

{a,b,d} 

4 

{4 

{4 

{a,b, c,/} 

{d} 

{a} 

{a,b,d} 


Example 3-4 {Continuation of examvle \3.S^ 

Consider the following run TZ of the multiagent system given in Example |^21 

. 2 -+I . (0,{im/c(Ai.A2)}) 

Ao -> Ai -> A 2 ^ . 

Initially, all links are intact and all inputs of agents are empty, i.e. INi^ = 0 for 
i = 1,..., 5. At point 0 in the run, agent A 2 sends to agent Ai information about 
shortest paths from her to other agents. At point 1 in the run, the link between Ai 
and A 2 is down. 

The information (output) an agent needs to send to other agents consists of 
shortest paths from her to other agents. Thus from the stable model of an agent 
we are interested only in this output. 

Let SPi^k be the set {sp{Ai,Y, D)\sp{Ai,Y, D) G Mi^k} where Mi^k is the stable 
model of Ai at point k. SPi^k denotes the output of Ai at point k. It is easy to see 
that if there is a transition A^ -—^ A^+i, then Aj sends to 


S = D{i,j)nMj^k = SPj,k 
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At point 0 , Ai and A2 have the following states and outputs: 

EDBio = {link{Ai,A2),link{Ai,A4)} 

INi^o = 0 

SPi,o = {sp(Ai, Ai,0)} 

EDB2fi = {link{A2,Ai),link{A2,A3),link{A2,A5)} 


IN, 


2,0 


SP2,0 = {sp{A2,A2,0)} 


A2 sends S to Ai in the transition Aq 


2^1 


Ai where 


S = SP2g = {sp{A2, A2,A)} 


Thus 

AVi 1 = Upai^2{INi^Q,S) = Upai^2{^,S) = S = {sp(A2, A2, 0 )} 

The environment change C = ( 0 , {link{Ai, A2)}) at point 1 is sensed by Ai and 
A2. The states of Ai and A2 are changed as follows: 


/A^ 1.2 

EDB \2 

1 ^ 2,2 

EDB2^2 


INi^i 

Upei{EDBx^i,C) = {EDBi^i \ {link{Ai, A2)}) U 0 
{link{Ai, A4)} 

IN 2,1 

Upe2{EDB2,i,C) = {EDB2 ,i \ {linkiAi, A2)}) U 0 

{link{A2, A^),link{A2, A 5 )} 


The following tables show the states and outputs of Ai and A2 at points 0 , 1 , 
and 2 respectively. 


Ai 

m 

EDB 

IN 

SP 

0 

{link{Ai, A2), link{A4, A4)} 


{sp(Ai, Ai,0)} 

1 

{link{Ai, A2), link{Ai, A4)} 

{sp(A2, A2,0)} 

{sp(Ai, Ai, 0), sp{Ai,A2, 1)} 

2 

{link{Ai, A4)} 

{sp(A2, ^2,0)} 

{sp(Ai, Ai,0)} 


A2 

k 

EDB 

IN 

SP 

0 

{link{A2, Ai), link{A2, A3), link{A2, A5)} 

0 

{sp(A2, A2,0)} 

1 

{/mfc(A2, Ai), link{A2, A3), link{A2, A5)} 

0 

{sp(A2, A2,0)} 

2 

{/mfc(A2, A3), link{A2, A5)} 

0 

{sp(A2, A2,0)} 


3.4 Stabilization 

Consider a superagent whose sensing capability and problem solving capability are 
the combination of the sensing capabilities and problem solving capabilities of all 
agents, i.e. this agent can sense any change in the environment and her intensional 
database is the union of the intensional databases of all other agents. Formally, the 
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superagent of a multiagent system 

A = {Ai ,..., An) 

where 

A, = {IDB,,HBE,,HIN,Ai), 5, 

is represented by 


Pa = {IDBa,6) 


where 


(EDB^JN,) 


• IDBa = IDBi U ■ • ■ U IDBn 

• 6 , the initial state of Pa, is equal to EDBi U • ■ • U EDBn 

The superagent actually represents the multiagent system in the ideal case where 
each agent has obtained the correct information for its input atoms. 

Example 3.5 (Continuation of Example \3.3ti 

Consider the multiagent system in Ey a,mol e ld. .‘11 At point 0, the superagent Pa is 
represented as follows: 

• IDBa consists of the following clauses: 

a-^b,c f^a b^a,d b e 

• S = {c,d,e}. 


Example 3.6 (Continuation of Example I 3 . 4 t 

Consider the multiagent system in Example EH Initially, when all links between 
nodes are intact, the superagent Pa is represented as follows: 

• IDBa consists of the following clauses: 

sp(x, X, 0) 
sp(x,y,d) 
spt(x,y,z,d+l) 

spl(x, x,d+\) 
spl(x,y,d+ 1 ) 

• The initial state 

(5 = { link(Ai, A2), link(Ai, A4), link(A2, A3), 
link(A2, A5), link(A'i, A5), link{A4, A5)} 

Note that the possible values of variables x, y, z are Ai, A2, A3, A4, A3. 


spt(x,y,z,d) 
link{x, z), sp(z, y, d), 
not spl(x, y,d+ 1 ) 

link{x, z), sp(z, y, d'),d' < d 


Definition 3.6 

Let A. be a multiagent system. 

The I/O graph of A denoted by Ga is a graph obtained from the atom depen¬ 
dency graph of its superagent’s intensional database IDBa by removing all nodes 
that are not relevant for any input atom in U ■ • ■ U HINn- 
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A is lO-acyclic if there is no infinite path in its I/O graph 
A is bounded if IDBj\ is bounded. 

A is lO-finite if its I/O graph is finite. 


Example 3.7 

The atom dependency graph of IDBj^ and the I/O-graph Ga of the multiagent 
system in Examples 13.31 andis given in Fig. [3 



It is obvious that the multiagent system in Examples IQ and 13.51 is bounded 
but not lO-acyclic and the multiagent system in Examples rmiTdirm and ESI is 
lO-acyclic and bounded. 


Proposition 3.1 

If a multiagent system A is lO-acyclic then IDBj\ is acyclic. 


Proof 

Suppose IDBa is not acyclic. There is an infinite path rj in its atom dependency 
graph starting from some atom a. There is some agent Ai such that a G PdBi. 
Since IDBi is acyclic, every path in its atom dependency graph is finite, p must 
go through some atom b G INi to outside of Afs atom dependency graph. Clearly 
starting from b, all atoms in rj are relevant to b. The infinite path of rj starting from 
6 is a path in the I/O graph Ga- Hence Ga is not acyclic. Contradiction! □ 
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Definition 3.1 

Let 7^ = Aq ^ . Afe —» ... be a run and Mi^k be the stable model of Ai at point 

k. 

1. TZis convergent for an atom a if either of the following conditions is satisfied. 

• There is a point h such that at every point k > h, for every agent Ai 
with a £ HBi = head{IDBi) U HBEi U HINi, 

a € Mi^k 

In this case we write Conv{TZ, a) = true 

• There is a point h such that at every point k > h, for every agent Ai 
with a £ HBi, 

a ^ Ali i^ 

In this case we write Conv(TZ, a) = false 

2. TZ is convergent if it is convergent for each atom. 

3. TZis strongly convergent if it is convergent and there is a point h such that 
at every point k > h, for every agent Ai, Mi^k = Mish¬ 
it is easy to see that strong convergence implies convergence. Define 

ConviJZ) = {a | Conv(TZ, a) = true} 
as the convergence model of TZ. 

Let TZ = Ao ^ Ai ^ ... —> Ak ^ ... be a run where Ak = (ci,*,..., an,k) 
with ffi^k = {TSDBi^k, As there is a point h such that the environment 

does not change after h, it is clear that \/k > h : EDBi^k = EDBih. The set 

n 

EDB = U EDBi^h is called the stabilized environment of TZ. 

i=l 

Definition 3.8 

• A multiagent system is said to be weakly stabilizing if every run TZ is 
convergent, and its convergence model ConvfTZ) is a stable model of Pa in the 
stabilized environment of TZ, i.e. Conv{TZ) is a stable model of IDBaC EDB 
where EDB is the stabilized environment of TZ. 

• A multiagent system is said to be stabilizing if it is weakly stabilizing and 
all of its runs are strongly convergent. 

Theorem 3.1 

lO-acyclic and bounded multiagent systems are weakly stabilizing. 

Proof 

See [Appendix A| □ 


Unfortunately, the above theorem does not hold for more general class of multi¬ 
agent systems as the following example shows. 
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Example 3.8 {Continuation of examvle \3.3l a,nd \3.5ti 

Consider the multiagent system A and run TZ in Example Id.Ill It is obvious that A 
is bounded but not lO-acyclic. 

For every point fc > 4, Mi^k = {a, b, c, /}, M 2 ,k = {a, b, d}. Conv{TZ) = {a, b, c, d, /}. 
The stabilized environment of TZ is EBD = {c,d}. The stable model of Pj( in the 
stabilized environment of TZ is {c, d}, which is not the same as Conv{TZ). Hence the 
system is not weakly stabilizing. 

Boundedness is very important for the weak stabilization of multiagent systems. 
Consider a multiagent system in the following example which is lO-acyclic, but not 
bounded. 


Example 3.9 

Consider the following multiagent system 

A = {A^,A2) 


where 


IDBi = {g <— ^r(x) 

s{x) <— r(a;)} 
HBEi = {} 

H/iVi = {r( 0 ),r(l),...} 

EDBi^o = 0 /iVi,o = 0 


IDB 2 = {r{x + 1 ) ^ s{x) 

r(0) 

HBE 2 = {} 

HIN 2 = {s{0),s{1),...} 
EDB2p = % IN2,o = 9> 


Since HBE = HBEi U HBE 2 = 0, for every run TZ the stabilized environment 
of TZ is empty. The stable model of Pa in the stabilized environment of TZ is the set 
{r(0), r(l),... }U{s(0), s(l),... }. It is easy to see that for each run, the agents need 
to exchange infinitely many messages to establish all the values of r{x). Hence for 
every run TZ, for every point /i > 0 in the run: q S Mi a, but q is not in the stable 
model of Pa in the stabilized environment of TZ. Thus the system is not weakly 
stabilizing. 


Are the boundedness and lO-acyclicity sufficient to guarantee the stabilization 
of a multiagent system? The following example shows that they are not. 

Example 3.10 {Continuation of Example \3.4\ a,nd \3.(^ 

Consider the multiagent system in Exa,mp]e ld. 2 l Consider the following run TZ with 
no environment change after point 6 . 


Ao — 

^ Ai 

■ A2 — 

(1) 

. mi' 

ink{Ai ,^ 2 )}) 
-) 

. A4 — 

(2) 

. mi' 
^5 

-) 

■ Ag — 

(3) 


A7 — 

> 

00 

i 

(4) 


Initially all links in the network are intact. The states and outputs of agents are 
as follows: 


• EDBifi = {link{Ai, A 2 ),link{Ai, A 4 )}, 
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EDB 2 P = {link{A2,Ai),link{A2,A3),link{A2,A5)} 

EDB^fi = {Unk{A3,A2),link{A3,A3)}. 

EDBixt = {link{Ai^ Ai)^link{A4^^ A^)}. 

EDB^fi = {link{A3, A2), link^A^, A3), link^A^, A4)}. 

• INifi = 0 for i = 1,..., 5. 

• SPifl = {sp{Ai, Ai, 0)} for * = 1,..., 5. 

Recall that SPi^k denotes the output of Ai at point k and is defined as follows: 


= {sp(A,Y,D)lsp(A,Y,D) G 


The following transitions occur in P: 

• At point 0 , As sends SP^p = {sp(A5, A5, 0 )} to A2. This causes the following 
changes in the input and output of A2: 


1 ^ 2 , 1 — {sp(A5, As, 0 )} 

SP2,1= {sp(A2, A2,0),Sp(A2, As, 1)} 


• At point 1, As sends S'Ps,i = {sp(As, As, 0)} to A4. This causes the following 
changes in the input and output of A4: 


/A^4 2 = {sp(As, As, 0 )} 

SPa,2= {sp(A4, A4,0),sp(A4, As, 1)} 


• At point 2 , A2 sends 5'P2,2 = {sp{A2, A2, 0 ), sp(A2, As, 1 )} to Ai. This causes 
the following changes in the input and output of Ai: 


INi^3= {sp(A2, A2,0),sp(A2 , As, 1 )} 

SPi,3 = {sp(Ai, Ai, 0 ),sp(Ai, A2, l),sp(Ai, As, 2 )} 


• At point 3 , the link between Ai and A2 is down as shown in Fig. 13 This 



Fig. 3 . The network after the link between Ai and A2 is down 

causes the following changes in the states and outputs of Ai and A2: 


EDBii = {Zmfc(Ai, A4)} 


EDB2,4 = {link{A2, A3), link{A2, A3)} 



SPi,4 = {sp(Ai, Ai, 0 )} 


5'P2.4 = {sp(A2, A2,0), sp(A2, As, 1)} 
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• At point 4, A 4 sends SP 4^4 = {sp{A 4 , A 4 , 0 ),sp(A 4 , A 5 , 1)} to Ai. This causes 
the following changes in the input and output of Ai: 



• At point 5, the link between A 4 and A 5 is down as shown in Fig. 0] This 



A 3 


Fig. 4. The network after the link between A 4 and A 5 is down 

causes the following changes in the states and outputs of A 4 and A^: 


EDB4 Q = {link{A4, Ai)} EDB^ q = {link{A^, A2),link{A;^, A^)} 
= {sp(A5, A5,0)} IN^fi = % 

SP4,6 = {sp{A 4 , A 4 , 0)} SP^fi = {sp(A 5 , A 5 , 0)} 


• At point 6 , Ai sends SPi^ = {sp{Ai, Ai,Q), sp{Ai, A^,2)} to A 4 . This causes 
the following changes in the input and output of A 4 : 


IN4^7 = {sp{A5,A5,0),sp{Ai,Ai,0),sp{Ai,A5,2)} 

SP4,7 = {sp{A4,A4,Q),sp{A4,Ai,l),sp[A4,Az,‘A)} 


Note that at point 6 , sp(Ai, A 5 ,2) S i.e. the length of the shortest path 

from Ai to A 5 equals to 2, is wrong. But Ai sends this information to A 4 . 
Now the length of the shortest paths to A 5 of agents Ai, and A 4 equal to 2, 
and 3 respectively (i.e. sp(Ai, A^,2) G Mi,y and sp(A 4 ,A 5 , 3 ) G M 4 ^ 7 , are all 
wrong. Later on Ai and A 4 exchange wrong information, increase the shortest 
paths to A 5 after each round by 2 and go into an infinite loop. 

The states and outputs of Ai and A 4 at points 0 —> 8 are shown in Fig. Eland 
Fig. El respectively. 

This example shows that 
Theorem 3.2 

lO-acyclicity and boundedness are not sufficient to guarantee the stabilization of a 
multiagent system. 

As we have pointed out before, the routing example in this paper models the pop¬ 
ular routing RIP protocol that has been widely deployed in the internet. Example 
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k 

EDB 

IN 

SP 

0 

{link{Ai, A 2 ), 
link(Ai, A 4 )} 

0 

{sp(Ai, Ai,0)} 

1 

{link{Ai,A 2 ), 
link(Ai, A 4 )} 

0 

{sp(Ai, Ai,0)} 

2 

{link{Ai, A 2 ), 
link{Ai, A 4 )} 

0 

{sp(Ai, Ai,0)| 

3 

{link{Ai, A 4 )} 

{sp{A 2 ,A 2 , 0), sp{A 2 , A^,!)} 

{sp(Ai, Ai, 0), sp(Ai, A 2 ,1), 
sp(Ai, As, 2)} 

4 

{link{Ai, A 4 )} 

{sp{A 2 ,A 2 , 0), sp{A 2 , As, 1)} 

{sp(Ai, Ai,0)} 

5 

{link{Ai, A 4 )} 

{sp{A 2 , A 2 , 0), sp{A 2 , As, 1), 
sp(A 4 , A 4 , 0), sp(A 4 , As, 1)} 

{sp(Ai, Ai, 0), sp(Ai, A 4 ,1), 
sp(Ai, As, 2)} 

6 

{link{Ai, A 4 )} 

{sp(A 2 , A 2 ,0), sp{A 2 , As, 1), 
sp(A 4 , A 4 , 0), sp{A 4 , As, 1)} 

{sp(Ai, Ai, 0), sp(Ai, A 4 ,1), 
sp(Ai, As,2)} 

7 

{link{Ai, A 4 )} 

{sp{A 2 , A 2 ,0), sp{A 2 , As, 1), 
sp{A 4 , A 4 , 0 ), sp{A 4 , As, 1)} 

{sp(Ai, Ai, 0), sp(Ai, A 4 ,1), 
sp(Ai, As,2)} 

8 

{link{Ai, A 4 )] 

{sp{A 2 , A 2 ,0), sp{A 2 , As, 1), 
sp(A 4 , A 4 , 0), sp{A 4 , As, 3)} 

|sp(Ai, Ai, 0), sp(Ai, A 4 ,1), 
sp(Ai, As,4)} 


Fig. 5. State and output of Ai 


k 

EDB 

IN 

SP 

0 

{link{A 4 , Ai), 
link{A 4 , As)} 

9 

{sp(A4, A4,0)} 

1 

{link[A 4 , Ai), 
link{A 4 , As)} 

0 

{sp(A4, A4,0)} 

2 

{link{A 4 , Ai), 
link{A 4 , As)} 

{sp(As, As,0)} 

{sp(A 4 , A 4 , 0 ), sp{A 4 , As, 1)} 

3 

{link{A 4 , A 4 ), 
link{A 4 , As)} 

{sp(As, As,0)} 

{sp(A4, A 4 , 0 ), sp{A 4 , As, 1)} 

4 

{link[A 4 , Ai), 
Unk{A 4 , As)} 

|sp(As, As,0)} 

{sp(A4, A 4 , 0 ), sp{A 4 , As, 1)} 

5 

{link{A 4 , Ai), 
link{A 4 , As)} 

{sp(As, As,0)} 

{sp(A4, A 4 , 0 ), sp{A 4 , As, 1)} 

6 

{link{A 4 , Ai)} 

{sp(As, As,0)} 

{sp(A4, A4,0)} 

7 

{link{A 4 , Ai)} 

{sp(A 5 , As, 0), sp{Ai, Ai, 0), 
sp(Ai, A5,2)} 

{sp(A4, A 4 ,0), sp{A 4 , Ai, 1), 
sp{A 4 , As, 3} 

8 

{link{A 4 , Ai)} 

{sp(A 5 , As, 0), sp{Ai, Ai, 0), 
sp(Ai, A5,2)} 

{sp(A4, A 4 ,0), sp{A 4 , Ai, 1), 
sp(A4, As,3} 


Fig. 6. State and output of A 4 

Id. 101 shows that RIP is not stabilizing. In configuration^ the routers at the nodes 
Ai, A 4 go into a loop and continuously change the length of the shortest paths from 
them to A 5 from 2 to infinite. This is because the router at node Ai believes that 
the shortest path from it to A 5 goes through A 4 while the router at A 4 believes 
that the shortest path from it to A^ goes through A 4 . None of them realizes that 
there is no more connection between them and A^. The above theorem general- 

^ This is one of the key reasons why RIP, a very simple int ernet routing pr otocol, is gradually 
replaced by OSPF, a much more complex routing protocol l|Huitema^.2222J 
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izes this insight to multiagent systems. The conclusion is that in general it is not 
possible for an agent to get correct information about its environment if this agent 
can not sense all the changes in the environment by itself and has to rely on the 
communications with other agents. This is true even if all the agents involved are 
honest and do not hide their information. 

Obviously, if a multiagent system is lO-acyclic and lO-finite, every agent would 
obtain complete and correct information after finitely many exchanges of informa¬ 
tion with other agents. The system is stabilizing. Hence 

Theorem 3.3 

lO-acyclic and lO-finite multiagent systems are stabilizing. 

Proof 

See [Appendix B| □ 


4 Related Works and Conclusions 

There are many research works on multiagent systems where agents are formalized 
in terms of logic programming such as ) |Ciampolini et al. 2003| |, ([Kowalski and Sadri 1999|l . 

([Satoh and Ya.mamoto 2flT)^ . An agent in our framework could be viewed as an ab- 
ductive logic program as in dCiampolini et al. 2003| ), ([Satoh and Yama.moto 2n02|l 
where atoms in the input database could be considered as abducibles. Satoh and 
Yamatomo formalized speculative computation with multiagent belief revision. The 
semantics of multiagent systems, which is defined based on belief sets and the 
union of logic programs of agents, is similar to our idea of “superagent”. An agent 
in ( jCiampolini et al. 2003| ) is composed of two modules: the Abductive Reason¬ 
ing Module (ARM), and the Agent Behaviour Module (ABM). Agents are grouped 
within bunches according to the requirements of interaction between agents. The co¬ 
ordination (collaboration) of agents is implicitly achieved through the semantics of 
the consistency operators. In both works (( jCiampolini et al. 2003| | and ([Satoh a.nd Yama.moto 2nn2[l l 
the communication for agents is based on pull-technologies. The authors did not 
address the stabilization issue of multiagent systems. Sadri, Toni and Torroni in 
(ISadri et al. 200lT used a logic-based framework for negotiation to tackle the re¬ 
source reallocation problem via pull-based communication technology and the so¬ 
lution is considered as “stabilization” property. 

In this paper, we consider a specihc class of cooperative information agents with¬ 
out considering effects of their actions on the environment e.g. in ( jCiampolini et al. 2003| ), 

(IKowalski and Sadri 1999[l . ([Satoh and Yamamoto 200'^ . We are currently working 
to extend the framework towards this generalized issue. 

In this paper, a logic programming based framework for cooperative multiagent 
systems is introduced, and the stabilization of multiagent systems is then formally 
defined. We introduced sufficient conditions in general for multiagent systems under 
which the stabilization is guaranteed. We showed that lO-acyclic and bounded 
multiagent systems are weakly stabilizing. But lO-acyclicity and boundedness are 
not sufhcient to guarantee the stabilization of a multiagent system. We showed that 
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lO-acyclic and lO-finite multiagent systems are stabilizing. Unfortunately these 
conditions are strong. So it is not an easy task to ensure that agents eventually get 
right information in the face of unpredictable changes of the environment. 

Our research is inspired by the network routing applications. As the RIP l IHedrick 198811 . 
lIHuitema 20001) 1 is very simple and had been widely accepted and implemented. 

But the RIP has many limitations such as the bouncing effect, counting to infinity, 
looping, etc. Many versions and techniques of the RIP have been introduced to re¬ 
duce undesired features of the RIP, but the problem could not be solved thoroughly. 

With logic programming approach, we showed in this paper, the main reason is that 
in the RIP, the computation of the overall problem solving algorithm is distributed 
over the network, while the logic program which represents the routing algorithm 
is not lO-finite, the stabilization of the system is thus not guaranteed. It is also a 
reason why most experts prefer the OSPF () |Moy 1998| ), lIHuitema 200011 1. which is 
much more complicated and sophisticated protocol, to the RIP for network routing. 

We have assumed that information sent by an agent is obtained immediately by 
the recipients. But communications in real networks always have delay and errors 
in transmissions. We believe that the results presented in this paper could also be 
extended for the case of communication with delay and errors. 

In this paper communications for agents are based on push-technologies. It is in¬ 
teresting to see how the results could be extended to multiagent systems whose com¬ 
munication is based on pull-technologies f llSatoh and Yamamoto 200211 . (|Ciampolini et al. 2003|)). 


Appendix A Proof of theorem ED 

First it is clear that the following lemma holds. 

Lemma Appendix A.l 

Let M be a stable model of a logic program P. For each atom a: a G M iff there is 
a clause a ^ Bd in P such that M \= Bd. 

Given an lO-acyclic and bounded multiagent system A = {Ai,...,An). By 
proposition rm IDBy\ is acyclic. 

Let 

TZ = Ao^ - 

be a run of A such that after point h there is no more change in the environment. 
The stabilized environment of TZ is EDB = EDBi h U • ■ • U EDBn,h- Let |Pyi]l be 
the stable model of Pa in the stabilized environment of TZ, i.e. the stable model of 
IDBa U EDB. 

The height of an atom a in the atom dependency graph of Pa denoted by 7r(a) is 
the length of a longest path from a to other atoms in the atom dependency graph of 
Pa- Since IDBa is acyclic, there is no infinite path in the atom dependency graph 
of Pa- From the boundedness of IDBa, 7'‘(a) is finite. 


Theorem KL1 1 follows directly from the following lemma. 
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Lemma Appendix A.2 

For every atom a, TZ is convergent for a and conviJZ, a) = true iff a S [[-P^]- 

It is easy to see that lemma jAppendix A.2| follows immediately from the following 
lemma. 

Lemma Appendix A.3 

For every atom a, there is a point k > h, such that at every point p > k in TZ, for 
every Ai such that a £ HBi, a € Mi^p iS a € [PaI- 

Proof 

We prove by induction on 7r(a). For each i, let HBIi = head{IDBi). 

• Base case: 7r(a) = 0 (a is a leaf in the dependency graph of P^). 

Let Ai be an agent with a £ HBi. There are three cases: 

1. a £ HBIi. There must be a clause of the form a <— in IDBi. o ^ is also in 
IDBj\. At every point m>0, a £ Mi^rn and a £ [P^]]. 

2. a £ HBEi- There is no change in the environment after h, at every point 
k > h, a £ Mi^k iff a G EDBik iff a G |P>t]l. 

3. a G HINi- There must be an agent Aj such that D{i,j) yf 0 and a £ HBEj U 
HBIj. By definition 13.51 of the run, there must be a point p > h such that 
there is a transition 

A A 

ZAp > ZAp_^i 

Moreover, every transition that can delete (or insert) a from (or into) INi 
after point h must also have the form Ag -—^ for some Aj such that 

D{i,j) 7 ^ 0 and a £ HBEj U HBIj. By the definition of transition of the 
form A -—^ A' in definition E31 and the operator Lfpa in section 13.21 for a 
transition Ap -—^ Ap+i, Ai will update INi as follows 

/W.p+i = (IN,,p\D(i,j))US 

where S = D(i,j) n Mj^p. Since a £ D{i,j), a £ Mi^p+i iff a G INi^p+i iff 
a £ Mj^p. As shown in 1 and 2, at every point k > h, for every Aj such that 
a £ HBIj UHBEj, a £ Mj^k iff a G |P>t]]. So at every point k > p, a £ Mi^k+i 
iffaGlP^l. 

We have proved that for each Ai such that a £ HBi there a point pi such that at 
every point k > pi, a £ Mi^u iff a G [[Py^]. Takep = max{pi,... ,Pn)- At every point 
k> p, for every agent Ai such that a £ HBi, a £ Mi^k iff a G [Pyt]- 

• Inductive case: Suppose the lemma holds for every atom a with 7r(a) < m, m > 0. 
We show that the lemma also holds for a with 7r(a) = m + 1. 

Let Ai be an agent with a £ HBi. Clearly a ^ HBE A HBEi. There are two cases: 

1. a G HBIi. The atom dependency graph of Pa is acyclic, every child 6 of a 
has 7r(&) < m. By the inductive assumption, for each b there is a point pb 
such that at every point k > pb, b £ Mi^p,^ iff 6 G [P^l- The set of children of 
a in the atom dependency graph of Pa is the same as the set of atoms in the 
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body of all clauses of the definition of a. As IDBj\^ is bounded, a has a finite 
number of children in the atom dependency graph of and the definition of 
a is finite. Let Pa is the maximum number in the set of all such above pb where 
6 is a child of a. At every point k > pa, for every child b of a, by the inductive 
assumption, b G Mi^k iff & G [[Lbl]]. We prove that a G Mi^k iff a G I^U]]- 
By lemma [Appendix A.l| a G Mi^k iff there is a rule a <— Bd in Pi^k = 
IDBi U EDBi^k U INi^k such that Mi^k \= Bd. By inductive assumption for 
every b G atom{Bd), b G Mi^k iff & G [[LUl- Moreover a <— Bd is also a rule in 
Pa- Thus a G Mi^k iff there is a rule a ^ Bd in such that 1= Bd iff 
a G |Pyt]l (by lemma [Appendix A.l| ). 

2. a G HINi. As shown in 1, for every Aj such that a G HBIj there is a point 
Pj, such that at every point k > pj, a G iff a G |[P.a 1- Let p be the 
maximum of all such pj . Clearly, at every point k > p, for every Aj such that 
a G HBIj, a G Mj^k iff a G [[P.a]. 

Follow similarly as case 3 in base case of the proof, there is a point p' > p + 1 
such that at every point k > p', a G Mi^k iff a G Mj^k- It also means that at 
every point k > p', a G Mi^k iff a G [P^aI- 

We have proved that for each Ai such that a G HBi there a point pi such that at 
every point k > pi, a G Mi^k iff a G [Pyt]- Takep = inax{pi,... ,Pn). At every point 
k> p, for every agent At such that a G HBi, a G Mi^k iff a G [Pyt]- 

□ 


Appendix B Proof of theorem ESI 

Let A be an lO-acyclic and lO-finite multiagent system. Obviously A is also bounded. 
Let P be a run of A. By theorem 13.1 1 TZ is convergent. By lemma [Appendix A.3| 
for every atom a in Ga there is a point ka such that at every point p > ka, for 
every agent Ai such that a G HBi, cl G Mi^p iff a G [[P.a1- As Ga is finite, take 
the largest number k of all such kAs for every atoms a in Ga- Obviously, at every 
point p > k, for every agent Ai, Mi^k = Mi^p. Thus TZ is strongly convergent. The 
system is stabilizing and theorem 13.31 follows immediately. 
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